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1.  INTRODUCTION 

The  stochastic  filtering  theory  has  been  a  great  source  of  motivation  for 

research  in  the  field  of  stochastic  processes  and  there  is  abundant  literature 

on  the  subject,  (cf.  e.g.  [7],  [8],  [10],  [12],  [16],  [23],  [24]  and  references 

contained  therein).  One  of  the  main  motivation  of  research  has  been  the 

solution  of  the  filtering  equation.  Since  in  the  linear  case  the  filtering 

equation  has  an  explicit  solution,  the  early  attempts  of  approximate 

computations  in  the  nonlinear  case  were  based  on  the  linearization  techniques 

which  gave  rise  to  what  is  called  the  extended  Kalman-Bucy  filter;  (cf.  [8]). 

The  corresponding  approximations  only  aimed  at  the  computation  of  the 

conditional  expectation  of  the  state  variable  at  a  certain  instant  in  terms  of 

the  observations  up  to  a  certain  time.  The  computations  for  the  extended 

Kalman-Bucy  filters  are  easy  (particularly  in  the  discrete-time  case),  but  one 

inconvenience  of  the  method  lies  in  that  the  accuracy  of  the  approximation  can 

•< 

not  be  evaluated.  The  reference  probability  method  ([1],  [22],  [25])  allowing 
the  derivation  of  the  Zakal  equation,  has  opened  a  new  way  to  considering  the 
filtering  problem.  Although  there  is  no  method  for  actually  solving  the  Zakai 
equation  much  has  been  added  to  the  qualitative  study  of  the  filtering  process. 
On  the  other  hand,  the  reference  probability  method  has  been  very  useful  in 
developing  approximation  procedures  ([3],  [11],  [13],  [19],  [20])  some  of  which 
are  exposed  here. 

After  a  short  introduction  to  stochastic  filtering,  we  present  the 
approximation  procedures  based  on  the  periodic  sampling  of  both  the  observation 
and  the  signal.  Approximate  filters  obtained  there  correspond  to  the  discrete 
time  filtering  of  Markov  chains  with  values  in  some  IR^-space  and  are  expressed 
in  terms  of  integrals  depending  on  a  continuous  parameter,  which  render  the 
numerical  computation  difficult.  In  order  to  eliminate  this  difficulty  and  to 
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help  computations  we  propose  a  quantization  of  the  signal  and  the  observation 
processes.  The  proposed  approximation  schemes  follow  those  of  [11]  and  go  as 
follows  in  the  decreasing  order  of  difficulty  for  computations,  i)  Periodic 
sampling  of  the  observation,  ii)  periodic  sampling  of  the  signal,  iii)  Euler 
approximation  of  the  signal,  iv)  quantization  of  the  signal, 
v)  quantization  of  the  observation.  For  each  step  the  expression  of  the 
approximate  filter  is  given  and  the  corresponding  approximation  degree  is 
estimated. 

The  estimation  of  the  approximation  degrees  was  considered  in  [3],  [11]. 
[19]  and  [20],  but  always  with  the  boundedness  condition  on  the  modulated 
signal  h  or  some  restrictive  conditions  on  the  likelihood  ratio  excluding  the 
linear  model  from  the  approximation  procedures.  The  method  proposed  there  does 
not  necessitate  such  conditions;  it  only  requires,  as  in  the  aforementioned 
references,  Lipschitz  and  linear  growth  conditions  that  are  necessary  for 
benefiting  from  the  continuity  of  the  signal  process  and  of  its  various 
approxlmat ions . 

In  order  to  make  our  approach  as  general  as  possible  we  choose  a  model  in 
which  the  modulated  signal  and  the  drift  and  diffusion  coefficients  are  time 
dependent . 

The  approximation  degrees  obtained  here  are  of  the  order  of  •s/d.  as  in  [3] 
and  [11],  where  6  is  the  sampling  period  but,  because  of  the  widening  of  the 
conditions,  the  bounds  are  better.  In  [19]  and  [20],  approximation  degrees  of 
the  order  of  6  were  obtained  under  more  regularity  conditions  on  the  system  and 
in  a  slightly  different  frame. 

Section  2  is  a  short  presentation  of  the  reference  probability  method 
without  derivation  of  the  Zakal  equation,  since  we  only  approximate  the 
Kallianpur-Striebel  formula. 

Section  3  presents  the  first  three  approximation  schemes  and  the 
corresponding  recursive  equations  for  the  filters. 
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Section  4  presents  the  method  of  estimation  of  approximation  degrees  and 
gives  the  bounds  for  the  first  and  second  approximations. 

Section  5  considers  approximations  of  the  signal  by  sampling  and 
quantization. 

Section  6  derives  the  approximation  bounds  for  filters  corresponding  to 
various  approximations  of  the  signal  and  presents  a  method  of  quantization  of 
the  observation  process  preserving  the  degree  of  the  previous  approximations. 

2.  MODEL  AND  FILTER 

Throughout  this  work  the  following  usual  signal  and  observation  model  is 
considered. 

The  signal  process  is  a  q-dimensional  continuous  Markov  diffusion  defined 
by  the  stochastic  differential  equation 

(2.1)  xt  =  xQ  +  Sq  f(s.xs)ds  +  g(s.xs)dbs 

where  b.  called  the  state  noise,  is  an  r-dimensional  Brownian  motion, 
independent  of  x^,  and  f  and  g  are  functions,  sufficiently  regular  in  order  to 
guarantee  the  existence  and  uniqueness  of  the  solution,  [4],  [6].  The 
observation  process  is  a  p-dimensional  process  given  by 

(2.2)  yt  =  Sq  h(s.xs)ds  +  *t 

where  w,  called  the  observation  noise,  is  a  p-dimensional  Brownian  motion  and 
h.  called  the  modulated  signal,  is  supposed  to  satisfy  the  condition: 

(2.3)  E/J  |h(s,xs)|2ds  <  » 

for  all  t  <  «,  condition  under  which  the  filtering  equation  was  derived  in  [5]. 

In  the  general  setting  of  the  nonlinear  filtering  theory  [5],  b  and  w  are 
correlated  in  such  a  way  that  (b,w)  is  a  square  integrable  martingale.  For 
structural  reasons  that  will  appear  in  the  sequel,  approximation  schemes  using 
the  reference  probability  method,  as  in  this  work,  are  all  proposed  for 
independent  state  and  observation  noises.  We  are  thus  supposing  that  b  and  w 
are  independent. 
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We  denote  by  | • |  the  norm  in  Rn,  by  v*  the  iC^  component  of  a  vector  v  and 

by  m1^  the  entry  (i.j)  of  a  matrix  m.  |m*  |  stands  for  the  norm  of  the  vector 

m1’  =  (mij;  j=l,2,...).  We  also  write  |m|^  =  2  2(m^)^.  We  simply  denote  by 

1  j 

uv  the  scalar  product  of  two  elements  u.v  e  IRn. 

Since  a  filter  is  progressively  computed  in  time,  we  may  suppose  that  the 
time  parameter  of  all  the  processes  under  consideration  ranges  over  the  finite 
interval  [O.T]. 

Let  G  represent  any  one  of  the  functions  f  and  g.  Then  G  is  supposed  to 
satisfy  the  following  Lipschitz  and  linear  growth  conditions. 


(2.4) 


|G(t,x)  -  G(t'.x')|  S  Kn[|t-f|(l+|xMx,|)  +  |x-x'|] 


[  |G(t.x)|  *  Kq( 1+ |x | ) 

for  all  t.t'  e  [O.T]  and  x.x'  e  Rq,  where  Kq  is  a  positive  number  not  depending 


on  t.t' .x.x' . 

Xq  is  supposed  to  be  a  square  integrable  random  variable.  Independent  of  b 
and  w. 

Let  B  (resp.  Y)  denote  the  space  of  all  Rr  (resp.  R^-valued  continuous 
functions  on  [O.T]  and  denote  by  Rj,  (resp.  Y^.)  its  Borel  o-field  under  the 
sup-norm  topology.  R**  denotes  the  Borel  a-field  of  R^,  and  P(R^).  the  space  of 
all  bounded  Borel  functions  on  R**. 

P  is  the  probability  measure  on  R^  x  Bj,  x  Y^,  =:  Fj  induced  by  (Xg.b.y). 

We  suppose  that  all  the  probability  spaces  are  complete.  We  put  f)  =  Rq  x  B  x 
Y.  Therefore.  (fl.Fj.P)  is  the  probability  space  on  which  all  the  random 
processes  under  consideration  are  defined.  We  denote  by  F  (resp.  Yt)  the 
sub-a-fields  generated  by  {(xo’ks>ys):  s  £  (resp.  (yg;  s  $  t). 

According  to  the  Girsanov  theorem  [14],  there  is  a  probability  measure  Pq 
on  Fy,  equivalent  to  P,  under  which  y  is  a  Brownian  motion  independent  of 
(Xg.b)  whose  probability  distribution,  denoted  by  Q,  remains  unchanged.  The 
corresponding  Radon-Nikodym  derivative  is  given  by 


$ 


m 


m 


ilii 


(2.5)  §-  =  exp[jJ  Csdys  -  ±fj  |Cs|2ds].  with  Cs  =  h(s.xs). 


The  probability  law  of  y  under  Pq  is  denoted  by  Pq,  E(resp.  Eq,  E^,  Eq) 
represents  the  expectation  under  P  (resp.  Pq.Q.  Pq). 


We  put 


(2-6)  Zt  =exp[/'Csdys  -|j-'  |Os|2ds], 

The  process  Z  =  {Z  :  t  e  [0,T]}  is  a  martingale  with  respect  to  F  =  (F  ; 

E  —  —  L 


t  e  [0,T]}  and  Pn,  and 


zt  =  WEt)  -  dP^;  a  s- 


where  P^.  (resp.  P^  t)  stands  for  the  restriction  to  of  P  (resp.  P^). 
If  U  is  an  ^-measurable  integrable  random  variable,  then 

E0(Zt  uIXt>  ,  o 

(2.7)  E(U|Yt)  =  Ej(z'lY-tr  ~  ^  E0(U|^t)  *  E  <U) 


The  second  formula  is  a  consequence  of  the  Independence  of  b  and  w. 


A  finite  conditional  measure  can  be  defined  on  IRq,  such  that,  for  all  F 


e  P(lRq) 
(2.8) 


at(F)  =  EQ[ZtF(xt)]  =  EQ[ZtF(xt)|Yt]. 


The  measure-valued  process  a  is  called  the  unnormalized  filter  (or  filtering 
process)  whereas  the  process  w  defined  by  the  Kallianpur-Striebel  formula  [9]: 


(2.9) 


»t  (F)  =  at(F)/ot(l) 


is  called  the  (normalized)  filter  or  filtering  process. 

For  a  detailed  presentation  of  the  reference  probability  method  we  refer 
to  [1]  and  [22].  We  Just  mention  here  the  fact  that  an  application  of  the  Ito 
differentiation  rule  to  (2.8)  to  (2.9)  successively  leads  to  the  Zakai  equation 
[25]  and  to  the  nonlinear  filtering  equation,  obtained  in  [5]  by  an  application 
of  the  martingale  representation  theorem.  In  this  paper  we  do  not  deal  with 
these  equations.  The  approximations  we  consider  here  concern  formulas  (2.8) 
and  (2.9). 


3.  APPROXIMATIONS  BY  PERIODIC  SAMPLING 


3.1  FIRST  APPROXIMATION 

We  suppose  that  the  observation  process  y  is  sampled  with  a  constant 

period  of  length  6  and  y  is  known  by  its  samples  yQ  =  0.  yfi . yn6’‘"  with  n 

i  [T/6],  ([a/b]  denotes  the  integer  part  of  a/b).  For  a  function  F  on  [0,T]  we 
write  F®  =  F(n6)  -  F((n-1)6)  with  Fq  =  FQ.  We  put  N  =  [T/5]  and  y6  =  (y®; 

n=0. 1 . N}.  Under  PQ.  { y Jj’1;  1=1 . p;  n  =  1 . N}  is  a  set  of 

independent  Gaussian  random  variables  with  means  0  and  variances  6.  We  denote 
by  the  sub-o-field  of  Yt  generated  by  (y^;  n  i  [t/6]}.  The  filtering 
process  with  respect  to  the  sampled  observation  {y  K;  n=0 . N}  is  given  by 


(3.1) 

As  in  (1.9)  we  have 

(3.2) 


wJ(F)  =  E[F(xt)jYj].  for  F  e  /3{IRq), 


where 


(3.3) 


w*(F)  =  a^(F)/aq(l).  for  F  e  0(IRq) 


o6t{  F)  =  E0[ZtF(xt)|Y®]  =  Ey[ot(F)|Y^]. 


where  a  is  the  unnormalized  filtering  process  corresponding  to  the  sampled 


observation. 


For  F  e  /3(IRq)  we  have 


(3.4) 


where 


(3.5) 


o&t{  F)  =  EQ[F(xt)Z^] 


~6  ~  ^K6^ru6J  5  Ih5I2a 

Z  =  exp  2  (Hnyn  -  ^  |H  |  ) 

n=0 


(3-6)  Hn  =  6  ^(n-l)6  h(s-xs)ds*  Ho  = 

For  a  quick  proof  of  these  formulas,  derived  in  [11],  it  is  enough  to 

notice  that  Z^  is  the  ratio  of  the  probability  densities  of  (y^;  n  i  [t/6]} 

under  P  and  PQ,  given  x. 

A  recursive  computation  of  a ^  can  be  derived  from  (3.4)  as  shown  in  the 
following 


THEOREM  3.1 


i 


Let  us  put 


(3.7) 


z  ,  =  exp(H  y  -  f-  |H6|2) 
n6  nJn  2  1  n1  ’ 


and  define  the  conditional  kernel  ^n5(x(n_j jg* *)  on  ^  by 


(3.8) 


Ln6<K(n-l)6'F)  =  /RqF(u>L„6(x(n-l)5'du> 

"  Ea[z„aF(xn6> 'x(n-l)6^ 


for  all  F  e  P( IRq).  Then  ct^;  n  =  1 . N  satisfies  the  following  recurrence 


equation: 

(3.9) 


•  V'‘d(u'F)',("-‘)d(du) 


-  <„-l)6CI-n5(--F)] 


for  all  F  e  P(IRq);  i.e. 


o®fi(dx)  =  ®fn_n«CLn^(*.dx)]. 


(n-l)5L  n5' 


where  Oq  coincides  with  the  law  of  Xq. 


(3.10) 


For  (n-l)6  <  t  <  n6.  is  given  by 

at(F>  *  XKqVl)«.t("’F)<’(n-l)6(du) 


=  CT(n-l)5^P(n-l)6.t^*’F^ 


for  all  F  £  /3(IRq),  where  P  ,  s  <  t.  is  the  conditional  probability  kernel  of 

s » c 


x_  given  x  .  This  formula  can  also  be  written  as 
t  s 


-  d(n-l)6CP(n-l)6.t(--dx>  ’ 


Proof:  For  t  =  n<5,  formula  (3.4)  gives 


<4<F>  =  ^-1)6  zn6  F(\6» 


=  E<3(Z(n-l)6  EQ^zn6F(xn6^x(n-l)5^ 


=  EQ^Z(n-l)6Ln5(x(n-l)5,F)} 


This  is  formula  (3.9).  For  (n-l)6  <  t  <  n6,  =  Z{n-1)5-  ^en  (3-10)  is 

obtained  by 


9 


°t<F>  *  E<!Cz(n-l)6  F<\>1 

=  eQ<-d«  EV<\>i*(n-1)a:) 


sr 


© 

*«5i« 
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Formula  (3.9)  allows  the  recursive  determination  of  a  at  the  sampling 
points  and  formula  (3.10)  gives  it  at  any  other  point.  The  greatest  difficulty 

in  the  computation  of  a^g,  n=l . N,  by  (3.9),  lies  in  the  fact  that  the 

computation  of  the  kernel  L^g  necessitates  the  complete  knowledge  of  the 
probability  law  of  x.  This  is  very  unrealistic,  because  there  are  few 
nonlinear  diffusion  processes  whose  laws  can  be  handled.  We  therefore  simplify 
the  work  by  reducing  the  problem  to  the  knowledge  of  the  transition 
probabilities  of  x. 


3.2  SECOND  APPROXIMATION 


Wit 


We  approximate  IT  by 


(3.11) 


Si  =  6  J?n-l)6h(s,x(n-l)6)ds 


Then  depends  only  on  x^n_j Let  us  denote  it  by  zng.  The  kernel  L^g 
becomes 


(3.12) 


Ln6(x(n-1)6,F)  =  Zn6  P(n-l)5,n6(x(n-l)6’F) 


Q  ^ 

for  F  e  /3(IRq).  We  denote  by  a  the  unnormalized  filter  given  by  formulas  (3.9) 
and  (3.10),  after  LRg  is  replaced  by  Lng,  and  by  ir  the  corresponding  •*£ 

normalized  filter. 

9 

3.3  THIRD  APPROXIMATION 

V" 

Except  for  trivial  cases  the  computation  of  the  transition  probabilities 
Ps  (  of  a  diffusion  process  is  not  an  easy  task  and  needs  approximation  ^ 

procedures.  One  of  the  elementary  approximation  procedures  lies  in  the  Euler  ;V 

approximation  of  x  defined  by  \V 

(3.13)  xng  =  x^nlj6  +  f[(n-l)6,x^n_ljg]5  +  g[(n-l )6 .x^j j6]bn 

with  Xq  =  Xq.  The  estimation  of  the  approximation  degree  will  be  given  in  j 

Section  5.  [ 

J9 


It  is  seen  that  (x^;  n=0.1 . N}  is  a  Markov  chain  and  its  transition 

probabilities  can  be  formulated  in  terms  of  the  distributions  of  b^; 
n=l  .2 . N. 


We  approximate  x  by 


(3.14) 


N  . 

xt  =J0xn61[nMn+l)5[(t) 


We  then  replace  x  by  x  in  formulas  (3.4)  to  (3.9)  and  obtain  by  (3.9)  the 

At  A  g  A  g 

corresponding  unnormalized  filter  n=0, 1 . N.  We  put  =  ct^  for  n6  <  t 

Ag 

<  (n+l)6.  ct°  is  an  approximation  of  a.  We  denote  by  v  the  normalization  of 
a  . 


In  Section  5  we  shall  consider  another  approximation  where  x^  will  be 
replaced  by  a  finite  space  valued  random  variable.  Before  going  further  into 
the  approximation  procedures,  we  are  going  to  develop,  in  the  next  Section,  the 
general  method  of  estimation  of  approximation  degrees  and  apply  it  to  the  first 
and  second  approximations  which  have  their  own  theoretical  interest. 


4.  ESTIMATION  OF  APPROXIMATION  DEGREES. 

o 

Suppose  it  represents  any  approximation  of  w  corresponding  to  a  periodic 

sampling  of  y  with  period  6.  We  are  interested  in  the  asymptotic  behavior  of 
o  q  ^  o 

ir( F),  for  F  e  /3(IRM);  more  precisely,  in  proving  the  L  -convergence  of  ir(F)  to 
ir(F)  and  estimating  the  speed  of  convergence  as  6  -»  0. 

The  Lp-norm  under  P  (resp.  Pq)  is  denoted  by  ||*||  (resp.  ||*||q  p).  For 
an  IRn-valued  random  variable  U,  the  norm  ||U||p  is  defined  by  ||u||p  = 

E{[  2  (U1)2]p/2>. 
i=l 

In  all  the  approximation  schemes  considered  here,  Cg  =  h(s,xg),  s<t,  is 
approximated  by  a  left  continuous  step  process  which  is  constant  on  sampling 
intervals.  We  denote  by  6  the  process  coinciding  with  this  approximating 

L  #  S 

step  process  on  [0,[t/6]6]  and  vanishing  outside  of  this  interval.  We  put 

6,  =0  for  t<6.  Notice  that  =  6.  for  s  i  [t/6]5. 

t,s  l,st,s 


The  corresponding 


likelihood  ratio  formula  can  then  be  written  as  follows: 


(4.1) 


2t  =  exp(J*0  &t(Sdys  "  2-^0  ^t,s  I  ds^ 


For  the  first  (resp.  second)  approximation,  we  have 


(4.2) 
and  put 

(4.3) 


6  =  Hd  (resp.  H^)  for  (n-l)5  <  s  £  n6  i  t. 

t.s  nv  n' 

<s  (resp-  O  ■'=  8t.s- 


In  some  other  approximation  schemes,  as  in  the  third  approximation,  x  is 
replaced  by  another  process  x  approximating  it.  Particular  notations 
corresponding  to  these  schemes  will  be  introduced  when  we  shall  be  considering 


them. 

In  the  case  where  the  likelihood  ratio  Z  is  approximated  by  2,  the  filters 

o  o 

a  and  ir  are  approximated  by  a  and  ir,  respectively,  defined  by 
(4.4)  ot(F)  =  EQ[2tF(xt)]  and  wt(F)  = 

for  F  e  j3(IRq) . 

At  the  first  step  we  are  going  to  derive  a  bound  for  |  |ir(F)  -  ir(F)||^ 
under  the  hypothesis  that 


(4.5) 


(Ct;  t  e  [0,T]}  and  (&p  t;  te[0,T]}  belong  to 
L2([0.T]  x  n,  T  ®  Ft.  dt  x  dP) 


where  T  is  the  Borel  o-field  of  [0.T]. 

For  this  purpose  the  following  Girsanov  theorem  constitutes  a  useful  tool. 
We  write  it  as  a  lemma. 


LEMMA  4.1 

Under  the  probability  2,  defined  by  d?  =  2^,dPQ,  the  process 
(4.6)  wt  =  yt  -  Xq  &r,sds 

is  a  Brownian  motion  independent  of  (xQ,b)  and  the  law  of  (xQ,b)  is  always  Q.D 
The  mathematical  expectation  under  ?  is  denoted  by  2.  We  choose  F  e  0(01^) 


once  and  for  all  and  write 
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According  to  Lemma  2.1  we  can  write 


(4.H)  E0[2tlutl]  i  *  Sr0EHCJ2-let.sl2lds 

For  the  evaluation  of  the  first  term  of  the  right  hand  side,  we  remark 
o  a  5 

that,  for  fixed  x  and  x,  Zt  is  measurable  with  respect  to  Yt-  We  can  therefore 


write 


<4.‘5)  ’ 

i  E0{2t[Ej(|;'(Cs^t  s)dys|2|Yd)]1/2) 
o 

For  fixed  x  and  x.  the  stochastic  integral  of  this  formula  is  a  centered 

Gaussian  random  variable  and  we  need  to  calculate  its  conditional  second  moment 

with  respect  to  a  a-field  generated  by  a  finite  number  of  centered  Gaussian 

random  variables.  Therefore  the  conditional  expectation  of  the  stochastic 

integral  term  is  equal  to  its  projection  onto  the  Gaussian  space  generated  by 
&  5 

y^ . yng.  with  n=[t/6].  It  is  easily  seen  that 

WMt.w#  -  4<s  -  6t.s>dv 

O 

Since  (always  for  fixed  x  and  x) 

'o<C,-6t.S>dl,„  -  'X.S  *  et.5)dy5  -  X,  -  Ct.s>dy, 

is  independent  of  Y^,  we  see  that  the  conditional  variance  of  J“~( C  -  C  )dy 

C  U  S  i ,  s  s 

is  Xq|Cs  -  sl^ds.  Consequently,  we  have 

(4-16)  ^<I^<CS  -  8t.s>dytlX>  * 

=  C'o<,  -  e,.s)dys32  *  'X  -  c?./ds' 

By  using  again  Lemma  4.1,  from  (4.15)  and  (4.16)  we  derive: 

(4.17)  5 

S  E|/'(Cd  ,  -  et_,)dy,|  ♦  E(/'|C.  -  <s|2ds)1/2. 

By  Lemma  4.1  again,  we  have 


(4.16) 


I 

i 

B 


(4- 18)  6lJ0<Cf,s~*t.s)dysl  * 

i  -  e,.A.*i  *  -  8t.s>dSsi 

i  E^'o<<.s-6t.s)8t.sdsl  +  C^l^.s  -  8t,|2d^‘/2 

According  to  (4.16),  (4.17)  and  (4.18),  inequality  (4.14)  gives: 

(4.19)  E0C2t |Ut |]  S 

*  E^o<s  -  *  vfrK.A ,/ds>1/2  * 

*^|c9-<»l2d»)1/2^iEMcsl2-l6t.sl2Ms 

Inequalities  (4.13)  and  (4.19)  provide  a  bound  for  (4.11). 

2 

Let  us  denote  by  | *|  the  norm  in  L  i[0,t]  x  fl)  where  the  measure  is 
dtxdP.  Then  we  can  express  the  main  tool  which  will  allow  the  evaluation  of 
the  approximation  degrees  for  filters. 


MAIN  LEMMA  4.2 


Under  Hypothesis  (4.5),  the  following  inequality  holds. 


(4.20) 


i  l<*$,  *  *  «t|t)  * 

*  |cf  -  £titci  *  ietit). 


Now,  we  are  able  to  express,  in  terms  of  6,  a  bound  for  (4.10),  under  the 
following  hypothesis. 


(4.21) 


|h(  t,x)  -  h(f.x’)|  i  Kq[  |  t-t  ’  |(l+|x|+|x'  |)+|x-x'  |] 


|h(t,x) |  i  KQ(1  +  |x|). 


where  is  a  positive  number  not  depending  on  t,  t',  x  and  x‘.  We  could 
choose  Kq  different  from  the  one  used  in  (2.4)  for  f  and  g.  But  this  would 
render  the  notations  more  complicated. 

We  first  recall  the  following  classical  result,  (cf.  Section  5). 


There  exist  positive  constants  Kj  and  Kg  such  that 


(4.22) 


MxtM2  1  Ki  and  i!xt"xs[  l2  *  K2 1 t_s  * 


These  inequalities  are  only  consequences  of  the  square  integrability  of  x 


| 
1 

1 


PS 


and  of  conditions  (2.4)  for  f  and  g. 


In  this  section  we  only  consider  the  two  cases  of  the  first  and  second 

o 

approximations.  In  these  two  cases  x  =  x.  Inequalities  (4.21)  and  (4.22) 
guarantee  that  Hypothesis  (4.5)  is  fulfilled.  Therefore,  we  can  apply  Lemma 
4.2. 

For  w  =  ird,  (4.10)  and  (4.20)  give 

(4.23)  ||irt(F)  -  wJ(F)||1  S 

S  2|F  |  |C-C^|t  (2  +  JfC- Cj|t  +  ±| C+C^t) 

By  putting  t'=[t/6]5,  we  can  write 

❖  lcs  -  Cl,|2ds  ■ 

*  SCt-  E|C,|2<i,  *  J2ds  1 

S  «  sup  ||C  |||  *  f  sup  ||C  -C?  II2 
s  S$t 

(4.21)  and  (4.22)  give,  for  (n-l)6  <  s  £  nfi  i  t, 

(4.24)  IICs<sll2  i  HMs.xs)  -  Jj^.1)^(».\)d«|l2  = 

=  ill^_1)6[h(s.xs)-h(u.xu)]du|l2  $ 

*  K0<Kn-l)5E[|u‘S,(1+Kl+M>  +  IVXsl]2du}1/2  * 

*  Kq  [6(1+2K1)  +  K^?]. 

As  | |Cg | |2  i  KqJI+Kj).  we  can  write 

(4.25)  |C-C^t  $  K^l+Kj  +  VT  [Kg  +  (1+2K1)V6]}V?  =:  A ^6. 

We  also  have  | |C^  g | |g  i  Kq(1+Kj).  Therefore,  we  can  formulate  the 
following  result. 


THEOREM  4.3 


9 

Under  hypotheses  (2.4).  (4.21)  and  Xq  e  L  (O.F^.P)  we  have 

(4.26)  ||wt(F)  -  ir^FjHj  $  2||F||A6  Vfc 

where 


(4.27) 


A6  =  A1[2+|A1V6  +  VT  Kq( I+Kj)] 


with  A.  defined  by  (4.25). 


W 


..... 


»J1  m  .WJI  «JJ  «Jj  g  »J  »J!  IJffjUJ.1  ijV  A .  WUV'jviv.S 
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REMARK  4.4 


Inequality  (4.26)  holds  also  for  w  ,  corresponding  to  the  second 
approximation.  The  only  difference  in  the  proof  is  the  fact  that  in  (4.24)  x^ 
is  to  be  replaced  by  x^n_^5* 


REMARK  4.5. 

The  equality  Y  =  V  implies  that,  for  F  e  p(!q).  ir6(F)=E[F(x|.)  |Y?] 

=  6  =  = 

converges  to  ir(F)=E[F(xt) |Yt]  in  all  Lm,  m  £1,  [17].  The  convergence  is  even 

a.s.  if  the  sets  of  sample  points  (0,6 . N6)  form  an  increasing  sequence  as 

6  ->  0. 

5.  APPROXIMATIONS  OF  THE  SIGNAL  PROCESS 

k 

After  a  study  of  the  Euler  approximation  in  L  .  we  give  a  quantization 
scheme  preserving  the  degree  of  approximation.  First  of  all  we  are  going  to 
give  an  estimation  of  the  constants  K^k)  and  ^(k)  such  that  inqualities 

(5.1)  ||xt||k  1  Kx(k)  and  I  I  lk  <  ^(k)  |  t-s  | 1/2 

hold  when  Xq  e  L  .  For  k=2,  we  put  K^(2)=K^  and  ^(RJsKg. 

In  current  literature  ([4],  [6],  [14])  these  constants  are  determined  for 
even  k  by  using  the  Ito  calculus.  But  one  may  need  to  consider  the  above 
inequalities  for  arbitrary  k  ]>  2.  We  give  here  a  rapid  estimation  of  K^  and  K 
by  using  the  Burkholder-Davis-Gundy  inequality,  [2]. 

Suppose  Xq  e  L  ,  k  2  2,  and  let  N  be  a  positive  number  and  define 
T=inf(t; |x£ |^N).  Since  x  is  continuous,  and  |xq|<®  a.s..  t^O  for  sufficiently 
large  N  and  r-»T  a.s.  as  N  -*  «.  We  put  t^r  =  min(t.r).  In  order  to  simplify 
the  notations  we  write  ||*||  instead  of  I  1*11^- 
We  have 

(5.2)  xt  T  =  xQ  +  /qIj-q  Tj(s)f(s.xs)ds  +  SQ  1[Q  T](s)g(s.xs)dbs. 


t^T  1 


S  lix0ll  +  q 


III  1 

2  “  k  kr  3  ft 


t  k[  2  /£e(1[0  T](s)|fi(s.xs)|k)ds]k  + 


+4k(qt)2  k[  2  J5E(1[0  T](s)|g1*(s.xs)|k)ds] 


where  g*  represents  the  vector  (g1* . g*r)- 


For  k=2.  the  coefficient  4k  can  be  replaced  by  1.  By  using  (2.4)  we  can 


write 


Therefore 


i  I  _  I  i 

K  Tll  <  llx0ll  +  Vqt>2  (t2+4k>c  kc/oE(1+lvTl)kds3k- 


k  1 


IK  Tl|k  *  2k_1||x0||k  +  2k_1  K^(qt)2  (t2+  4k)k  t'1/*2k“1(l+|  |x  |  |k)ds 


£  2k_1  |  |xQ|  |k  +  22k-2  K^qT^T2  +  4k)k  + 
k  1_ 

+  22k‘2  K^(qT)2  (T2  +  4k)kT~1  /^||xs  T||kds. 


Then  the  Gronwall  lemma  gives 


i  A  exp  B 


(5.3) 


where 


A  =  2k_1 | |xQ| |k  +  B 

k  l 

B  _  22k-2  Kk(qT)2  (T2+4k)k 

Since  the  right  hand  side  of  the  last  Inequality  does  not  depend  on  N.  we  can 
let  N  go  to  infinity  and  obtain 

1_ 

(5.4)  ||xt||k  S  Ak  exp(B/k)  =:  Kj(k) 

Kg(k)  can  be  obtained  in  terms  of  K^(k),  starting  from 


i  -  I  1  -  I  I 

|xt-xsH  <  ^  V'8)  k[  ^  XgE(  |f1(u.xu)  |k)du]k  + 

1  1  1 


+  4k[q( t-s)] 


2  k  [  2  E( |g1*(u,x  ) |k)du]k, 
1=1 


with  t>s.  and  by  using  the  second  'nequality  (2.4)  for  f*  and  g1  and  (5.4). 

For  various  approximations  of  x  we  refer  to  [15],  [18]  and  [21].  We  just 

A 

derive  here  a  few  inequalities  concerning  the  Euler  approximation  x.  defined  by 


SVtWiTWf.v.TO 


M 

is 

m 


(3.13)  and  (3.14).  We  first  determine  a  bound  for  ll^lljj*  under  the 

v 

hypothesis  that  Xq  e  L  ,  k  £  2. 

A  A 

Let  us  define  f  and  g  as  follows 

(5.5)  f(t.xt)  =  f(n5.xn6),  g(t.x£)  =  g(n5.  xng).  for  nfi  i  t  <  (n+l)6. 


Then  we  can  write 


(5.6) 


Xn6  =  x0  +  ^  f(s.xs)(s.xa)d»  +  Sq6  g(s.xg)dbs 


and  use  the  method  that  allowed  the  passage  from  (5.1)  to  (5.4)  to  find  that 

A 

| |x  allk  also  is  bounded  by  K^(k)  given  in  (5.4). 

a 

The  same  method  can  be  applied  for  an  estimation  of  ||xng-x  -||x.  ^e  have 
for  t  =  n<5 

l  l  _  I  n_i 

llxt'xtll  *  Ko(<lT)2  (T2  +  4k>T  k(”y[J+1)6E[(s-i6)(l+|xsK|xi6|)  + 

1 

+  lXS  '  Xifil  +  lX<A  "  X«  J]kds>k 


i6  ~i6l 


1  1 


llxt-xtHk  <  [K0(qT)2  (T2  +  4k)]k  T"1  2k_1  {T^H^k))  +  K2(k)V6]1 


+  6  i^  Ixi6~xidl  * 


By  putting  ug  =  | lx^ x^g I  I  for  i8  i  s  <  (i+l)6,  the  sum  in  the  above 

inequality,  multiplied  by  6  can  be  written  as  /*u  ds.  Therefore,  the  Gronwall 

u  s 

lemma  can  be  applied  and  gives  the  following  inequality. 


|xn5  "  xn$^k  *  <A  exp  B*  V 6 ’  where 


(5.7) 


A  =  (kB)k  [(l+^^k))  V6  +  K^k)] 


1  -  r 


1  1 


=  £{2  k  K0(qT)2  (T2  +  4k)]k  . 


Finally,  for  arbitrary  t  e  ]n6,  (n+l)6[,  we  can  write 


(5.8) 

We  define 


lxt  "  xtHk  *  [A  exp  B  +■  K2(k)]  vfc  . 


(5.9) 


K(k)  ••=  A  exp  B. 
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Next,  we  proceed  to  the  quantization  of  x. 

We  fix  k  once  and  for  all  and  suppose  that  Xq  has  a  continuous 
distribution  function  with  finite  kC^  absolute  moment. 

In  order  to  simplify  the  notation  we  write  Equation  (3.13)  as  follows: 


(5.10) 


<n  =  Xn.1  +  f(n-l.Xn_1)  +  g(n-l.  X^j)  Vfc  bn>  n=0,l . N 


where  (b^,  n=0,l . N,  i=l . q)  is  a  set  of  independent  normalized  Gaussian 

/V  A  /S 

random  variables  and  X  .  f(n-l,X  ,),  g(n-l,X  ,)  stand  for  x  ...  f((n-l)6. 

n  v  n-l'  n-l'  no 

A  /V 

X(n-1)6>  ’  x(n-l)6^  ’  resPectively  • 

We  choose  a  finite  increasing  sequence  Uq.u^ . uj  *n  R  and  real 

1-1 

coefficients  a_.a, . a.  ,  in  such  a  way  that  if  B  =  2  a.l,  and  if  x 

0  1  I“1  i=o  1  *Vui-nJ 

is  a  rssal  random  variable  with  distribution  N(0,1),  we  have  |  |x-B(x)  |  |^  i  -r. 

— j  i 

We  put  bn  =  B(b^)  and  a  =  sup  (a,  | .  We  approximate  x^  by  a  finite  space  valued 

n  n  k  ° 

—  —  - 
random  variable  x  in  order  to  have  | |xq-Xq| £  i  and  denote  a ^  =  sup  |Xq(u) | . 

1 .<•* 


We  approximate  (X^)  by  a  finite  space  valued  Markov  chain  (Xn)  defined  by 


(5.11) 


<  =  X  ,  +  f (n-l ,  X  ,)6  +  g(n-l ,  X  , )  vfc  b  . 
n  n-l  v  n-l'  n-l'  n 


The  components  of  X  take  a  finite  number  of  values  in  an  interval  [-a. a].  The 

~i  j 

number  a  will  be  determined  in  the  sequel.  Functions  f  (n,*)  and  g  (n,»)  are 

— |  — |  j 

approximated  by  step  functions  f  (n.*)  and  g  J(n,»)  on  [-a, a],  such  that 

sup  |f1(n,x)  -  T^n.x)!  $  tj  and  sup  |g^(n,x)  -  g^fn.x)!  i  q. 
i.n.x  i.j.n.x 

(the  components  of  x  are  restricted  to  [-a,  aj).  The  values  of  6,  >/5.  x^,  b^ . 

“N  — 4  4 

f  .  g  J  are  chosen  in  a  finite  periodic  subset  of  [-a, a]. 


write 


By  taking  the  difference  of  the  two  equations  (5.10)  and  (5.11)  we  can 

IIV’Ul  *  HVrViH  *  Vi*1 16  * 

*  ll?(n-l.  Xn_,)  -  7(n-l.  Xn_,)  |  |C  *  ||g(n-l.  X^,  )(b„-bn)  |  |V5 


T 


+  |  |[g(n-l .Xn_j)  -  g(n-l.Xn_1)]bn||  y/6  + 

+  l|[g(n-l.  Xn_j)  -  g(n-l ,Xnl)]bn| |>/<5  * 

*  I  lXn-l  ~  Vl  I  I  +  K0I  lXn-l  -  Xn-1 1  +  **  + 

+  Vqr  K^l+K^kJjW?  +  Vq^llX^  -  X^  1 1  (M(k)+Tf)V6  + 

+  y/qTTi  (M(k)  -r ) 

where  M(k)  is  the  L  -norm  of  a  random  variable  with  distribution  N(0,1)  and  we 
denoted  ||*||,,  simply  by  ||*||  and  used  the  inequality  |  |b  |  1^  £  |  | l>n |  | ^  + 


|  |b  -b  |  L. 
1  1  n  n1  'k 


We  can  write 


(5.12) 


||X  -  X  ||  £  u | |X  .-X  ,||+v 

1 1  n  n1 1  11  n-1  n-1 1 1 

where 

u  =  1  +  Kq5  +  VqrKQ(M(k)  +  -r  )v£ 
v  =  Vq  V5  [rjy/6  +  rKg(l  +  Kj(k))-r+r(M(k)  + 


Successive  iterations  of  this  inequality  give 


(5.13) 


|  |X  -  X  |  |,  £  v  u-  +  un-r 

' 1  n  n' 'k  u  -  1 


We  want  I |X  -X  II,  to  be  of  the  order  of  >/5.  Therefore,  we  can  choose 
1 1  n  n 1  'k 


(5.14) 


-N  jr  -N  J- 

r]  =  v^  u  v6,  -r  =  VgU  vo 


where  N  =  [T/6]  and  v^  and  Vg  are  constants  that  can  be  chosen  independently  of 


Denoting  by  K(k)Vi5  the  right  hand  side  of  (5.13)  when  17  and  t  are  replaced 


by  (5.14)  we  write 


(5.15) 


l|Xn  “  XJ!k  *  K(k)>/6  • 


The  approximation  of  f(n,*)  and  g(n,*)  by  step  functions  on  [-a. a]  depends,  of 
course,  on  the  magnitude  of  a.  Therefore  we  need  to  determine  a  lower  bound 
for  it.  Equation  (5.11),  can  be  written  for  the  i1*1  component  as  follows-- 


A/Vv’v C  'i*1.  ■'•/v'sVsV-, V\r,.v %*  v  v  ■ 
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K  *  ?„-i  +  *V>-  X»-l>5  *  ^  bt 

=  x‘.j  +  [Pfn-l.X,.,)  -  rVl.X^,)^  *  ^(n-l.X^jJi  * 

+  2i[rJ(n-l.Xn_1)  -  ^(n-l.X^jyfi  ?  +  ^ 

From  this  *re  deduce, 

|X*|  *  IPjI  +  t,6  +  Kq(1+  |Xn_j  |)6  +  rarjVte  +  rKQa(  1+ IX^  | )  V6 

Let  us  put  a  =  sup  |X1(<j)|.  Then  we  can  write 
n  i  ,<j  n 

aR  £  an_i  +  tj6  +  Kq{  1  +  Vq  aR_ ^ ) 6  +  rarp^S  +  rK^af  1+Vq  a^_ ^  )Vfi 

an  £  a^_ ^  ( l+K^vtiVS ( ra  +  Vfi)  )  +  V5(t)  +  Kq)  ( ra  +  >/5) 

By  iterating  successively  we  get  the  following  inequality  for  a  : 

fTJ  +  Kn  —  —  —  N  TJ  +  Kn 

(5.16)  £  - +  a0  [1  +  ^Vq  V6(ra  +  Vfi)] - =:  a 

K0Vq  K0Vq 

where  N  =  [T/6]. 

We  see  that  once  6  is  given,  rj  and  t  can  be  chosen  according  to  (5.14). 
The  choice  of  i  Imposes  that  of  a,  and  finally  a  can  be  chosen  to  be  equal  to 
the  right  hand  side  of  (5.16). 

A  —  —  — 

Suppose  that  we  approximate  x^  =  X^  by  xr^  =  Xr  as  above  and  we  def ine  x 
by 


(5.17)  x£  =  x^g  for  n5  £  t  <  (n+l)6. 

We  obviously  have  |  |xt  "  xt  £  K(k)V<5,  (cf.  (5.15)).  By  replacing  x  by  x  in 
the  third  approximation  we  get  new  unnormalized  and  normalized  filters  that  we 

denote  by  and  w^.  This  approximation  procedure  is  the  fourth  we  are 


considering  here. 


The  quantization  scheme  presented  above  depends  largely  on  k.  As  in  the 

2 

next  section,  we  only  consider  L  -approximations  of  x,  it  is  then  more 
convenient  to  construct  x  and  the  corresponding  filters  for  k  =  2. 


fi 


6.  EFFECT  OF  THE  APPROXIMATIONS  OF  THE  SIGNAL  PROCESS  AND  OF  THE  QUANTIZATION 
OF  THE  OBSERVATION  PROCESS 

Since  we  only  need  L^-norms  for  the  evaluation  of  a  bound  of  |  |  [q 

A  — 

all  the  constants  K^k).  K^k).  K(k).  K(k)  etc.  of  the  preceding  section  will 

simply  be  written  without  the  argument  k  as  K^.Kg.K.K  etc.  Similarly.  |  | *  |  l2 
will  be  denoted  by  ||*||.  The  same  symbol  is  also  used  for  ||F||  as  the 
sup-norm  of  F.  We  shall  avoid  any  possible  ambiguity  by  clarifying  the  meaning 
when  we  shall  deal  with  the  sup-norm. 

o 

We  go  back  to  Formula  (4. 10)  where  the  superscript  represents  the 
modified  objects  of  the  first  approximation,  obtained  after  x  is  replaced  by  x 

or  x.  constructed  in  Section  5.  with  k=2. 

We  need  to  evaluate  a  bound  for  (4.20)  and  we  first  deal  with 
| |Cs  -  ||.  We  have,  for  (n-l)5  <  s  $  n6  £  t, 

(6.1)  MCS  ~£ttSN  =  llMs-xs)  “  i  •r(n-l)6h{u,X(n-l)6)dul  I  * 

1_ 

*  ^Cl)«E,h(S-Xs)-h{U-Vl)5)|2du]2i 

*  K0  W  +  I  KM  +  Mx(n.1)6ll)  ♦  l|x8  -  x(n_1)6||  + 

+  Mx^n_1j6-x^n_1j6l  |  +  £Mx(n_1j6-x(n_1j6N} 

o  O  — 

where  t  =  0  if  x  =  x  and  fc  =  1  if  x  =  x. 

As  ||xn6||  $  ||xn5||  +  ||xnfi  -  xng  | | .  according  to  (5.15),  we  can  write 

(6.2)  MxJI  $  Kj  +  Kvfc 
Therefore  (6.1)  becomes 

||Cs  -  St  SM  *  Kq{6(1+2K1  +  eKV6)  +  (I^  +  K  +  eKjvfc) 
where  K  is  given  by  (5.9). 

Consequently. 

(6.3)  |C  -  £tlt  S  (A;  +  K0VT  [eK  (1+6)  +  K]}  Vfc 
where  A^  is  given  by  (4.25). 


Similarly,  we  have 


(6.4)  ||Ct  s  -  Ct  s|  |  =  il5X(n.1)6[Mu.xu)  -  h(u.x(u_1)6)]du||  <; 

*  K  sup  | |xy  -  x  )6| |  £  K0(K2  +  K  +  eK)V6 
where  (n-l)6  <  u  £  n6  £  t.  Therefore 

(6.5)  |C^  -  fitlt  S  vtK0{K2  +  K  +  eK)y/6 
We  also  have 

(6.6)  |C  |t  +  |6tlt  *  VT[K0(1+K,)  +  ^(l+Kj  +  eKvfc)]  = 

=  2vT  KQ( 1+K1 )  +  eVr  KQ  Kv6 

and 

(6.7)  |Stlt  $  Vt^l*^  ♦  eK  Vfc) 

By  bringing  (6.3  - 7)  and  (4.25)  Into  (4.20)  we  get 

_  1_ 

(6-8)  ||Zt  -  2t||j  6  2 

*  Aj  +  (Aj  +  e'KQ  vT  [tK(l+6)  +  K]}  (1  +  ' KQ>/F|[tK(  1+6 )  +  K]}  + 

+  VF  KQ  (1+Kj)  +  KQKVte} 

+  e’VT  KQ(K2  +  K  +  eK)Va  [l+vTK0(l+K1+eKV5)] 

=:  aJ  (e.e) 

where  e '  =  1 . 

For  the  evaluation  of  a  bound  of  (4.10)  we  need  to  compute  a  bound  for 
I |F(xt)  -  F(x  )  1 1  j .  We  then  suppose  that  F  is  uniformly  Lipschitz  continuous 
i  e. . 

(6.9)  |F(x)  -  F(x')|  $  K|x-x'|,  Vx.x'  e  !Rq 

with  a  constant  K. 

We  therefore  have 

(6.10)  | |F(xt)-F(xc) | |x  $  K||xt-xt||2  S  e'K(K2+K+6K)Vfe  =:  A^(e\e)>/6 
where  e '  =  1 . 

Finally  we  have  the  following  extension  of  Theorem  4.3. 


THEOREM  6.1 


Under  hypotheses  (2.4),  (4.21),  (6.9)  and  xn  e  L  ,  we  have 


(6.11) 


I  k(F)  -  tt(F)  |  |  x  <  [2 1  ( F  |  |A^(e.'  ,e)  +  A®(e'.e)]V!5 


where  ||F||  is  the  sup-norm  of  F,  and  k^  are  given  by  (6.8)  and  (6.10), 


respectively. 

For  e’=0,  the  right  hand  side  of  the  inequality  gives  a  bound  of 
|  |ir(F)-ir^(F)  |  |  ,  (but  in  this  case  the  Lipschitz  continuity  of  F  is  not 
needed),  for  e'=l  and  £=0  it  gives  a  bound  for  |  | tt ( F )  — tt  ||^  and  for  e'=l  and 

e=l  a  bound  for  |  |ir(F)-»^  |  |  ^ .  O 

a 

We  recall  that  the  quantization  of  x  was  made  under  the  supplementary 
hypothesis  that  the  distribution  function  of  Xq  is  continuous. 

If  the  values  taken  by  (y  ^)  were  exactly  known,  then  the  approximate 

filter  could  be  computed  with  a  desired  accuracy  by  a  finite  number  of 
operations.  But  the  observation  is  usually  measured  in  terms  of  units  of  a 
finite  set:  more  precisely,  measurement  devices  offer  only  quantized  values  of 
the  observation.  The  problem  s  to  characterize  a  quantization  of  (y^)  and 
therefore  of  (y  ,.)  which  would  not  affect  the  degree  of  approximation  of  tt. 


Let  us  put 


(6.12) 


where  is  given  by 


(6.13) 


Zt  =  «pCVV  y*  -  |  |H*|2) 
n= ) 


hfs,x(n-l)6*ds 


and  x  is  the  quantized  approximation  of  x  for  k=2. 

Z  is  the  likelihood  ratio  corresponding  to  the  fourth  approximation 
procedure.  We  shall  replace  y^  by  a  finite  space  valued  random  variable 
approximating  it.  More  precisely,  we  choose  the  real  step  function 
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(6.14) 


C(X)  =  £  Cj  1]VjiVj+i](x).  v0<Vl<...<Vj 


with  finite  J  and  define  =  (y^1 . y^P)  by 


(6.15) 


-6,1  6.1, 

yn  *  C(yn  > 


in  such  a  way  that  if  y^  is  replaced  by  y^  in  (6.12)  the  corresponding  filter 
w  should  be  close  to  it. 


We  put 


(6.16) 


(6.17) 


3 

I  lyn  “  yn^  lo,4  =  *b2  311(1  c  =  sup  CJ 

J 

?  ,„6  “6  6  .  — S .2. 

Zt  =  exp  2  (Hn  y„  -  J  I  H„1  ) 

n=0 


and  define  and  by 


(6.18) 


a*(F)  =  EQ[ZtF(xt)]  and  ?*(F)  =  5*(F)/a*(l). 


for  all  F  e  /3(IRq). 

We  remark  that  is  not  the  likelihood  ratio  corresponding  to  y^.  but  ir^ 

is  still  a  probability  distribution  on  the  finite  space  of  values  of  x. 

In  order  to  simplify  the  problem  we  first  suppose  that  h  is  bounded. 

o  o  —(5 

Formulas  (4.7)  and  (4.8)  are  still  valid  with  a  and  tt  replaced  by  a  and 

=6 

it  ,  and  we  can  write 

(6.19)  ||ir(F)  -  ^(FJMj  i  2 1  |F  |  |  \\Zt-Zt\\QA  +  I  |Zt[F(xt)  -  F(xt)]||0  y 


Putting 


"ze  -  z«llo.i  ‘  IM.IIo.i  *  llzt-ztn0,i 


Z  =  Z  -  Z  +  Z 

t  t  t  t 


and  bringing  into  (6.19)  we  can  write 

(6.20)  ||et(F)  -  i'(F)||,  S  2||F||  l|2t-Ztll01  ♦  I lF(xt)-F(*t) I Ij 

*  2||F||  ||Zt  -  Ztll0  ,  *  ll(Zt-it)  [F(xt)  -  F(;t)]|l0  , 
Notice  that  the  first  two  terms  of  the  right  hand  side  dominate 


. .s 


'  '  •  a%  m  *  J*  *  **"•  "*  a  ■  m  %  a •  »  W  .»,»  b  »  '  »  "  >  1  a  “  M  •  »  '  a  *  a  *  a  *_*  *  a  •  _*W  /»  »  •  .  *  "»  _Ni  -N  -  *  _  •  .  «  *•  _% 

a  /a  «VA  /a  /a  ^  /a  .<««*  a  *.  A  •'.V.  AA  •'a  AA  «VA  ».  A  AA 


| I*  (F)-ir^(F) | Ij  and  its  bound  is  given  in  Theorem  6.1.  Therefore,  we  only 
need  to  compute  a  reasonable  bound  for  the  sum  of  the  third  and  fourth  terms. 
According  to  (6.10),  this  sum  is  bounded  by 

(6.21)  ||Zt-Zt||0  2(2||F||  +  K||xt-xt||2) 

£  I |Zt  -  Zt||0  2  [2||F||  +  K(K2+K+K)v/fi] 

Therefore  we  need  to  make  | |Zt~ Zt | |q  2  small. 

By  putting  ||h|j  =  sup  |h(t,x)|  we  can  write 

t.x 

lM.llo.2  1  U[t^]  "X  -  yn)'lo.4 

n=u 


We  have 


S  T||h||W6  (l|ZtH0  4  +  |  iZtl  l0  4) 

l|Ztll0  4  $  exp(|r  ||h||2)  =:  and 

[t/6]  6  5  -  o,  . _  4cT 


Zt  =  '“PL4  2  K  '  I  K™  i  CXP  6 

n=0 


Therefore 


(6.22)  I  lZt-Zt  I  l0.2  i  Tl  lhl  [K3  +  exp 

The  quantization  can  be  carried  out  in  such  a  way  that 

(6.23)  *  =  DCKg  +  exp  -SliML]*1 

where  D  is  a  constant.  We  then  obtain  a  bound  for  |  |ir(F)  -  ir  (F)||j, 

proportional  to  V6. 

Therefore  we  can  state  the  following 


THEOREM  6.2 

Under  the  hypotheses  of  Theorem  6.1  and  for  bounded  h,  variables  y^; 

— g 

n=l,2 .  [T/6].  can  be  approximated  by  finite  space  valued  y  ,  as  defined  by 

(6.15),  in  such  a  way  that  (6.23)  is  satisfied.  In  this  case  if  yn  is  replaced 

by  y^  in  the  expression  of  yielding  a  new  filter  i^.  then 


(6.24) 


I  k(F)-»  (F)|  |j  $  2||F||[A"(1.1)  +  A"(l,l)]vfc  + 

+  TD |  |h 1 1[2|  | F 1 1  +  KOCj+K  +  KJvfcjvfc 

where  the  first  term  of  the  right  hand  side  is  the  bound  of  | |w(F)  -  ir^(F)||j 
given  by  (6.11)  for  e‘=e=l  and  D  is  a  conveniently  chosen  constant  for  the 
fulfillment  of  (6.23).  □ 

The  procedure  leading  to  is  the  fifth  and  the  last  of  the  approximation 
procedures  considered  here. 

REMARK  6.3 

In  the  case  where  h  is  bounded,  the  second  inequality  of  (4.21)  is  not 
necessary  and  corresponding  modifications  of  A^  and  A^  can  be  easily  made.  But 
it  is  always  possible  to  get  rid  of  the  boundedness  condition  of  h  in  the  last 

theorem.  In  fact  ir^  can  be  approximated  by  a  truncation  of  h  in  such  a  way 
tr 

that  if  ir  is  the  filter  of  the  fourth  approximation  corresponding  to  the 

tr  i  i ””  “  tr  i  • 

truncated  h  say  h  ,  then  | |ir(F)  -  w  (F) | is  bounded  by  a  quantity 

proportional  to  >/6.  In  this  case  the  fifth  approximate  filter  can  be 
constructed  with  htr  and  give  again  for  |  |ir(F)  -  tt^(F)  1 1  j  a  bound  proportional 

to  V5. 
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